Effects of uncertainties and errors on Lyapunov control 
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Lyapunov control (open-loop) is often confronted with uncertainties and errors in practical appli- 
cations. In this paper, we analyze the robustness of Lyapunov control against the uncertainties and 
errors in quantum control systems. The analysis is carried out through examinations of uncertainties 
and errors, calculations of the control fidelity under influences of the certainties and errors, as well 
as discussions on the caused effects. Two examples, a closed control system and an open control 
system, are presented to illustrate the general formulism. 
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I. INTRODUCTION 

Quantum control is the manipulation of the temporal 
evolution of a system in order to obtain a desired target 
state or value of a certain physical observable, realizing 
it is a fundamental challenge in many fields [iHjl, in- 
cluding atomic physics molecular chemistry (jf and 
quantum information Q. Several strategies of quantum 
control have been introduced and developed from classi- 
cal control theory. For example, optimal control theory 
has been used to assist in control design for molecular sys- 
tems and spin systems 0, Q • A learning control method 
has been presented for guiding the control of chemical 
reactions [a]. Quantum feedback control approaches in- 
cluding measurement-based feedback and coherent feed- 
back have been used to improve performance for several 
classes of tasks such as preparing quantum states, quan- 
tum error correction and controlling quantum entangle- 
ment [H, [l(| ■ Robust control tools have been introduced 
to enhance the robustness of quantum feedback networks 
and linear quantum stochastic systems (ill [l2| . 

Control systems are broadly classified as either closed- 
loop or open-loop. An open-loop control system is con- 
trolled directly, and only, by an input signal, whereas 
a closed-loop control system is one in which an input 
forcing function is determined in part by the system re- 
sponse. Among the open-loop controls, Lyapunov control 
has been proven to be a sufficient control to be analyzed 
rigourously, moreover, this control can be shown to be 
highly effective for systems that satisfy certain sufficient 
conditions that roughly speaking are equivalent to the 
controllability of the linearized system. 

Lyapunov control for quantum systems in fact use a 
feedback design to construct an open-loop control. In 
other words, Lyapunov control is used to first design a 
feedback law which is then used to find the open-loop 
control by simulating the closed-loop system. Then the 
control is applied to the quantum system in an open-loop 
way. From the above description of Lyapunov control, 
we find that the Lyapunov control includes two steps: 
(1) for any initial states and a system Hamiltonian (as- 



sumed to be known exactly), design a control law, i.e., 
calculate the control field by simulating the dynamics 
of the closed-loop system, (2) apply the control law to 
the control system in an open-loop way. Although some 
progress has been made, more research effort is necessary 
in Lyapunov control, especially, the robustness of quan- 
tum control systems has been recognized as a key issue 
in developing practical quantum technology. In this pa- 
per, we study the effect of uncertainties and errors on 
the performance of Lyapunov control. The uncertainties 
come from initial states and system Hamiltonian, and er- 
rors may occur in applying the control field (control law). 
Through this study, we show the robustness of Lyapunov 
control against uncertainties and errors. In particular, 
the relation between the uncertainties and the fidelity is 
established for a closed two-level control system and an 
open four-level control system. 

This paper is organized as follows. In SecHU we intro- 
duce the Lyapunov control and formulate the problem. A 
general formulism is given to examine the robustness of 
the Lyapunov control. In Sec. IIII1 we exemplify the gen- 
eral formulation in Sec|H] through a closed and an open 
quantum control systems. Concluding remarks are given 
in Sec. [TV] 



II. PROBLEM FORMULATION 

A control quantum system can be modeled in differ- 
ent ways, either as a closed system evolving unitarily 
governed by a Hamiltonian, or as an open system gov- 
erned by a master equation. In this paper, we restrict 
our discussion to a iV-dimensional open quantum system, 
and consider its dynamics as Markovian. The discus- 
sion is applicable for closed systems, since closed system 
is a special case of open system with zero decoherence 
rates. Therefore we here consider a system that obeys 
the Markovian master equation (h = 1, throughout this 
paper), 

p=-i[H,p)+£(p) (1) 
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m— 1 



H = Hn 
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n=l 



f n (t)H n , 



where A m (m = 1,2,...,M) are positive and time- 
independent parameters, which characterize the deco- 
herence and are called decoherence rates. Furthermore, 
J m (m = 1,2,...,M) are the Lindblad operators, Ho is 
the free Hamiltonian and H n (n = 1, 2, F) are control 
Hamiltonians, while /„(<) (n — 1,2, ...,F) are control 
fields. Equation (JT]) is of Lindblad form, this means that 
the solution to Eq. ([T]) has all the required properties 
of physical density matrix at any times. Since the free 
Hamiltonian can usually not be turned off, we take non- 
stationary states po(t) as target states that satisfy, 



f>D(t) = -i[H , p D (t)}. 



(2) 



The control fields {/ n (t), n = 1,2,3,...} can be estab- 
lished by Lyapunov function. Define V(po, p), 



V(pd,p) = T^(Pd) - Tr(ppo), 



(3) 



we find V > and 



V = -^fn{t) r Tr{p D [-iH nt p]}-Tr\p D C[p)]. (4) 



For V to be a Lyapunov function, it requires V < 
and V > 0. If we choose a tiq such that 
f no (t)Tr{p D [-iH no , p]} + Tr[p D C(p)\ = 0, and f n (t) = 
Tv{p D [~iH n , p]} for n =/= ri , then V < 0. With these 
choices, V is a Lyapunov function. Therefore, the evolu- 
tion of the open system with Lyapunov control governed 
by the following nonlinear equations 15] 



m 

fn(t) 
fn (t) 
PD(t) 



= -i[H + fn(t)H n , p(t)\ + C{p), 
n 

= Tr{[-iH n ,p]p D }, for n ^ n , 
Ti[p D £(p)} 



Tr{p D [p,iH„ ]} 
-i[H Q ,p D (t)} 



, and 



(5) 



is stable in Lyapunov sense at least. In Eqs © and ([3]), 
we have identified poif) with target states, this means 
that if a quantum system is driven into the target states, 
it will be maintained in these states under the action of 
the free Hamiltonian. However, in practical applications, 
it is inevitable that there exist errors and uncertainties in 
the free Hamiltonian, in the initial states and in the con- 
trol fields. These uncertainties and errors would disturb 
the dynamics and steer the system away from the target 



state. In the following, we suppose that the uncertainties 
can be approximately described as perturbations 5Hq in 
the free Hamiltonian, and as deviations Spo in the initial 
state as well as fluctuations Sf n (n may take 1,2,3,...) 
in the control fields. Then the actual final state pn(t) of 
the control system starting from (po + Spo) governed by 
Eq. © with (H + 5H ) and [f n (t) + Sf n (t)} instead of 
H and f n (t) would be different from p_o(t). We quan- 
tify the difference between the target states po(t) and 
the practical states pn(t) by using the fidelity defined by 



F(pd,Pr) = Try PhPRPb- 

For a Lyapunov control with negative gradient of Lya- 
punov function in the neighborhood of target states, the 
controlled system state will be attracted to and main- 
tained in the target state, when there are no uncertainties 
and errors. With uncertainties and errors, the problem 
of robustness of the control system is not trivial, because 
the Lyapunov-based feedback design for the control law 
would induce nonlinearity in the control system. The 
LaSalle invariant principlejl4| tells that the autonomous 
dynamical system Eq.© converges to an invariant set 
defined by £ = {pi n : V = 0}, which is equivalent to 
fn(t) = 0, n = 1, 2, 3, ... by Eq.©. This set is in general 
not empty and the final state will be in it. From Eqs. (|4]) 
and © we find that the invariant set is an intersection 
of all sets £ n (n = 1, 2, 3, n ^ no), each satisfies, 

£n = {Pin,n ■ ^(PdH n p in ^ n ~ H n p d p m , n ) =0}, II / U Q . 

(6) 

Since the control fields are proportional to V, the errors 
in the control fields would change the invariant set. The 
uncertainties in the initial state affect the invariant set 
in the same way, and the uncertainties in the free Hamil- 
tonian change the target sets Pd(t), leading to an invari- 
ant set different from that without uncertainties. In the 
next section, we will illustrate and exemplify the effect 
of errors and uncertainties on the fidelity through simple 
examples. 



III. ILLUSTRATION 

In this section, we first introduce a Lyapunov control 
on a closed two-level quantum system, then we study 
the robustness of this Lyapunov control by examining 
the effects of uncertainties and errors on the fidelity of 
control. Next, we extend this study into open systems by 
considering a dissipative four-level system and steering it 
to a target state in its decoherence- free subspace (DFS). 

We start with a closed two-level system described by 
the Hamiltonian, 



H=-a z + f(t)a x =Ho + H u 



(7) 



where Ho = jcr z denotes the free Hamiltonian of the 
system, Hi = f(t)a x is the control Hamiltonian with 
a control field f(t). We define one of the eigenstates of 
Ho, say the ground state \g), as the target state, the 
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FIG. 1: (Color online) Fidelity of Lyapunov control versus 
the uncertainties in the free Hamiltonian (left) and in the 
initial states (right), to = 4 (in arbitrary units) and <f>o = 
f3o = ? are chosen for this plot. 

Lyapunov function in Eq. Q for this closed system is 
then 

V(\g),\m)) = l-\(9Mt))\ 2 - (8) 

For closed system, the Liouvillian C(p) vanishes, thus we 
do not need to choose a control field f no (t) in Eq. ([5]) 
to cancel the drift term. The only control field f(t) that 
can be derived from Eq. ([5]) is, 

f(t) = 2Im((g\a x \m)m)\9))- (9) 

Here |3>(i)) represents states at time t starting from an 
initial states 

|$(0)> =cos/3 |e)+sin/3 e^| ff ), 

under the action of the Hamiltonian H without any un- 
certainties and errors. We further suppose that the un- 
certainties in the free Hamiltonian Hq can be described 
as a perturbation, 

5H = S x a x + S z a z , (10) 

and the uncertainties in the initial state |$(0)) can be 
characterized by replacing /3q and </>o with (/3q + <5/3o) and 
(4>q + (50o ) j respectively. We describe the errors in the 
control fields f(t) as fluctuations 8(t) ■ f(t) with random 
number S(t). With these descriptions, the practical con- 
trol system can be described by, 

ttjj W*)>* = l H o + SH a + /(t)ffi(l + 5(t))]\ip(t)) R , 

(11) 

with initial condition |$(0) + 5$(0)) = cos(/3 + 5/3 )\e) + 

We have performed numerical simulations for Eq. , 
selected results are presented in figures [1] and [3J Figure 
[T] shows the control fidelity as a function of uncertain- 
ties (5 x -i S v ) in the free Hamiltonian and uncertainties 
(5/3o,5<f>o) in the initial state. Two observations can be 
made from the figures. (1) The control fidelity rapidly 
depends on the uncertainties 5 z a z , whereas it is not sen- 
sitive to 8 x a x , (2) the control fidelity is an oscillating 
function of <5/3o and 54>o with different periods. These ob- 
servations indicate that the Lyapunov control on closed 
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FIG. 2: (Color online) Fidelity of Lyapunov control as a func- 
tion of time. This plot shows the effects of fluctuations in the 
control field f(t) on the fidelity, (a), (b) and (c) are for differ- 
ent types of fluctuations, (a) The fluctuation S(t) was taken 
from ( — 1) to zero; (b) from ( — 1) to (+1); and (c) from 
to (+1). All fluctuations are taken randomly. The other pa- 
rameters chosen are the same as in Fig. [T] There are no 
uncertainties in the free Hamiltonian and in the initial states. 

systems is robust against the uncertainties that commute 
with the control Hamiltonian, while it is fragile with the 
other uncertainties in the free Hamiltonian. This claim 
is confirmed by Fig. ® where the effect of fluctuations 
in the control field on the control fidelity is shown. One 
can clearly see from figure [5] that there are almost no ef- 
fects for the fluctuations with zero mean on the fidelity. 
This can be understood as follows. Since the fluctuations 
is randomly chosen for the control fields, the net effect 
intrinsically equals to an average over all fluctuations, 
which must be zero for fluctuation with zero mean. 

Now we turn to another example that shows the ro- 
bustness of Lyapunov control on open quantum systems. 
We borrow the model in Ref.pjl shown in Figj3j where 
a four-level system coupling to two external lasers and 
being subject to decoherence has been considered. The 
Hamiltonian of this system has the form, 

2 2 

H j>01 + (E%l°)01 + h.c), (12) 

J=0 j=l 

where flj (j = 1,2) are coupling constants. Without 
loss of generality, in the following the coupling constants 
are parameterized as fii =17 cos</> and Q2 — ^ sin</> with 
£1 = yOf + O2 . The excited state |0) is not stable, it 
decays to the three stable states with rates 71 , 72 and 73 
respectively. We assume this process is Markovian and 
can be described by the Liouvillian, 

3 1 1 

with a J — |0)(j| and — (cj)^- It is not difficult to 
find that the two degenerate eigenstates \Di) = cos 0|2) — 
sin 0| 1), |£>2) = |3), of the free Hamiltonian Hq form a 
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FIG. 3: The schematic energy diagram. A four-level system 
with two degenerate stable states |1) and |2) in external laser 
fields. The two degenerate states are coupled to the excited 
state |0) by two separate lasers with coupling constants S7i 
and 0,2, respectively. While the stable state |3) is isolated 
from the other levels. The excited state |0) decays to \j) 
(j — f, 2, 3) with decay rate •jj. 



DFS. Now we show how to control the system to a desired 
target state (e.g., \Di)) in the DFS. For this purpose, we 
choose the control Hamiltonian 



(14) 



3=1 



with H\ is a 4 by 4 matrix with all elements equal to 1. 
H 2 = \D X ){D 2 \ + \D 2 )(Di\,H 3 = \0)(D 2 \ + \D 2 ){0\. We 
shall use Eq. ([5]) to determine the control fields {/«(£)}, 
and choose 



|*(0)) = sin/3icos^ 3 |0) +cos/3icos^ 2 |l) 
+ cos/3i sin/3 2 |2) + sin/3i sin/3 3 |3) 



(15) 



as initial states for the numerical simulation, where /?i , (3 2 
and /?3 are allowed to change independently. The initial 
state written in Ea. dTBl omits all (three) relative phases 
between the states |0), |1), |2) and |3) in the superposi- 
tion, and satisfies the normalization condition. fi(t) here 
is specified to cancel the drift term Tr[£(p)4] in V, this 

f 2 (t) and fs(t) are de- 



; Tr(£(p)A) 
'Tr([A,Hi]p) 



means that fi(t) = 

termined by Eq.©. 

We examine how the uncertainties in the free Hamil- 
tonian and initial states as well as the errors in the con- 
trol fields f n (t),(n = 1, 2, 3, ...) affect the fidelity of the 
control. These effects can be illustrated by numerical 
simulations on Eqs (|12ll3ll4|) . with the free Hamiltonian 
Hq, the initial state |$(0)) and the control fields f n (t) re- 
placed by {H + SH ), |$(0) + <5$(0)) and f n (t){l + S n ), 
respectively. Here, 

SH a = A X (|0)(1| + |1)(0|) + A,(|0)<2| + |2)(0|), 



) + <5$(0)) = BinC8 1 + <y j 9i)cosj8 a |0> 
0x + 8^) cos(/3 2 + 5&)\1) 
' 5j3x)sm(j3 2 +5!3 2 )\2) 
sin(/3i+ 80i) sin /3 3 |3), 



|$(0) 
+ cos 
+ cos(^i 




FIG. 4: (Color online) The fidelity of control as a function of 
uncertainties in the free Hamiltonian (left) and in the initial 
state (right). The other parameters chosen are £1 — 5, cj> = 

f,/3 3 = f,A = f,/?2 = f,7i = 72 = 73 = \l,K 2 = 1, 
Ao = 4, Ai = A2 = 2 and 7 = 1. <5/3i and Sfo are in unites of 

7T. 




(16) 
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FIG. 5: (Color online) Fidelity of Lyapunov control versus 
time t. The fluctuations S n (n = 1, 2, 3, ...) range from (-1) to 
(+1) for the upper panel, while from (—1) to (or to (+1)) 
for the lower panel, (a) in both panels denotes the probability 
in state \D\), while (b) in state \D%). The other parameters 
chose are the same as in Fig. [3] 



and S n are random numbers ranging from —1 to +1. The 
fidelity versus the uncertainties (characterized by A x , A z , 
SPi,5p 2 ) and errors {5 ni n — 1,2,3,...) are presented in 
figures |4] and [5] Figures |4] and [5] tell us that the Lya- 
punov control on open system with the target state \D\) 
is robust against the uncertainties in the initial state, and 
the fidelity is above 95% when the uncertainties in the 
free Hamiltonian is bounded by 0.5 (in units of 7). The 
Lyapunov control is also robust gainst the fluctuations in 
the control fields as figure [5] shows. We note that 

the effects of fluctuations with zero mean are different 
from that with non-zero mean. This can understood as 
an average results taken over all fluctuations. 



IV. CONCLUDING REMARKS 

To summarize, we have examined the robustness of 
Lyapunov control in quantum systems. The robustness 
is characterized by the fidelity of the quantum state to the 
target state. Uncertainties in the free Hamiltonian and in 
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the initials states as well as the errors in the control fields 
diminish the fidelity of control. The relation between the 
uncertainties (errors) and the fidelity is established for 
a closed two-level control system and an open four-level 
control system. These results show that the Lyapunov 
control is robust against the type of uncertainties which 
commute with the control Hamiltonian, while it is fragile 
to the others. The fidelity is not sensitive to zero mean 



random fluctuations (white noise) in the control fields, 
but it really decreases due to the non-zero (positive or 
negative) mean fluctuations. 
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